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Abstract: A two-player stochastic difFerential game representation has recently been ob- 
tained for solutions of the equation —AacU = /i in a domain with Dirichlet boundary 
condition, where h is continuous and takes values in R \ {0}. Under appropriate assump- 
tions, including smoothness of u, the vanishing S limit law of the state process, when 
both players play 5-optimally, is identified as a diffusion process with coefficients given 
explicitly in terms of derivatives of the function u. 
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1. Introduction and main result 



Consider the equation 

—2AooU = h in G, 

(1.1) 

u = g on dG, 

where, for an integer m > 2, G C M™ is a bounded domain, and g € C(5G,M) and the 
functions h £ C(G,M \ {0}) are given. The infinity-Laplacian is defined as 

provided Df ^ 0, where for a function / we denote by Df the gradient and by D'^f the 
Hessian matrix. We refer the reader to [l|, 0, 3) S] for background on the infinity-Laplacian 
and some related PDE theory. This paper is motivated by recent work of Peres et. al. [3], where 
a discrete time random turn game, referred to as Tug-of-War, is developed in relation to (jl.ip . 
This game, parameterized by e > 0, has the property that the vanishing-e limit of the value 
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function uniquely solves (jl.ip in the viscosity sense (a result that is valid also in the homogenous 
case, h = 0, excluded from the current paper). The stochastic differential equation (SDE) 

dXt = 2p{Xt)dWt + 2q{Xt)dt, (1.2) 

where 

Du 1/2 

^^JlM' 1 = ^jy^{D uDu- A^uDu), (1.3) 

is suggested in ^ as the game's dynamics in the vanishing-e limit. The relation is rigorously 
established in examples, but only heuristically justified in general. In a two-player zero-sum 
stochastic differential game (SDG) is considered, for which the value function uniquely solves 
(jl.ip in the viscosity sense. The goal of the present paper is to show that, with appropriate 
conditions, ()1.2p can be rigorously interpreted as the optimal dynamics of the SDG. Defined in 
the Elliott-Kalton sense, the SDG of [3| is formulated in such a way that one of the players 
selects a strategy, and then the other selects a control process (see Definition 11.11 below) . We 
will assume in this paper that the equation possesses a classical solution u i.e., with non- 
vanishing gradient. Under this assumption we specify, for each 5 > 0, a 5-optimal strategy j3^, 
and a control process that is 5-optimal for play against , in terms of first and second 
derivatives of u. We then identify the limit law, as (5 — > 0, of the state process under {P^,Y^), 
as the solution X to the SDE (II. 2p . stopped when X hits the boundary dG. 

A stronger result, of identifying the limit under any (5-optimal play, is of interest but appears 
to be difficult, and is not treated in this paper. 

The construction of near optimal strategy-control pairs, that may be of interest by its own 
right, is based on an interpretation of (jl.ip as the following Bellman-Isaacs type equation (see 
also (I23D) 

sup inf \ --{a-by{D^u){a-b)-{c + d){a + b)-Du} = h. 

|6|=l,d>0 |a|=l,c>0 1^ 2 J 

In this form there is a natural way to construct strategy and control, by associating the supre- 
mum and infimum with the two players. The variables a, b, c and d selected by the players 
dictate the coefficients of the game's state process, and, as we prove, the coefficients con- 
verge to those of equation ()1.2p in the limit as the supremum and infimum are achieved. This 
convergence is then lifted to the convergence of the underlying processes to the diffusion (jl.2p . 

In the rest of this section, we describe the setting and state the main result. The proof 
appears in Section 2. 

Throughout, we will make the following 

Assumption 1.1. There exists a C^(G') function u, with Du on G, that solves (II. ip in 
the classical sense. 

As a consequence of 0] , that proves uniqueness (and existence) of viscosity solutions to (II. ip 
under the above assumptions on h, the function u of Assumption 11.11 is the unique classical 
solution of (II. ip . 
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We now present the SDG. Let (J7, JT, {Tt}-, P) be a complete filtered probability space with 
right-continuous filtration, supporting an [m + l)-dimensional {jF^j-Brownian motion W = 
iyV,W), where W and W are 1- and m-dimensional Brownian motions, respectively. Denote 
by E the expectation with respect to P. Let Xt be a process taking values in M"*, given by 

Xt = x+ [\As - Bs)dWs + l\Cs + Ds){As + Bs)ds, t G [0, oo), (L4) 
Jo Jo 

where x ^ G, At and Bt take values in the unit sphere S"^^^ C M'", and Ct and Dt take values 
in [0, oo). Denote 

Y^ = {A,C), Z^ = {B,D). (L5) 

The processes and take values inTL = 5™""^ x [0, oo). These processes will correspond 
to control actions of the maximizing and minimizing player, respectively. For a process = 
[A^ C) taking values in TL we let S{H^) = ess sup sup^gjQ o^-j Ct- In the formulation below, each 
player initially declares a bound 5, and then plays so as to keep S{H^) < S. 

Definition 1.1. (i) A pair H = {{Ht}, S), where 5 € N and {Ht} is a process taking values in 
TL, is said to be an admissible control if {Ht} is {Tt} -progressively measurable, and S{H^) < S. 
The set of all admissible controls is denoted by M . For H = {{Ht}, S) € M , denote S{H) = S. 
(a) A mapping g : M ^ M is said to be a strategy if, for every t, and H, H €z M , 

P{H^ = H^ for a.e. se [0, t]) = I and S = S 

implies 

P(/0 = /O for a.e. se [0, t]) = 1 andT = f, 

where {I^,T) = q[{H^,S)] and {I^,T) = q[{H^,S)]. The set of all strategies is denoted by F. 
For g £ F, let S{q) = supji^g^ S{q[H]). Let 

F = {ger : S{q) < oo}. 

Note that the Brownian motion W does not appear explicitly in the state dynamics, however 
the control processes may depend on W. Such a formulation where the underlying filtration 
is rich enough to support an (m + l)-dimensional Brownian motion originates from Swiech's 
construction [Ifl], and is crucially used in the proof of wellposedness of the SDG (see [sj for 
details). 

We will use the symbols Y and a for a generic control and strategy for the maximizing 
player, and Z and /? will denote the same for the minimizing player. For a process ^ taking 
values in R*" and a set A C M"*, we will write Tyi(^) for 

inf{t >0:Ct^A} 

(where the infimum over an empty set is oo). Let 

r = tg{X). 
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We write 

X(x,y°,Z°) [resp., r(x,y°,Z°)] (1.6) 

for the process X [resp., the random time r] when it is important to specify the expHcit 
dependence on {x,Y^,Z^). If r < oo a.s., then the payoff J{x,Y^,Z^) is weU defined with 
values in [—00,00], where 



J(x,y°,ZO) = E 







h{X,)ds + g{X^) 



(1.7) 



and X is given by (11. 4p . When P{t{x,Y^ , Z^) = 00) > 0, we set, consistent with the ex- 
pectation of the first term in (jl.7p . J{x,Y^,Z^) to be +00 [—00] for the case /i > [resp., 
h < 0]. 

If y = (yO^K),Z = (ZO,L) G M, we sometimes write J{x,Y,Z) = J{x, {Y° , K), {Z^ , L)) 
for J(x,Y^ , Z^). Similar conventions will be used for X{x,Y,Z) and t(x,Y,Z). Occasionally, 
with an abuse of terminology, when Y = {Y^, K) G M, we will write Y^ G M. Let 

j^(y,/3) = j(x,y,/3[y]), x g g, y g m, /? g r, 

J'^(a,Z) = J(x,a[Z],Z), x G G, a G T, Z G M. 

Define analogously X^(y, /3), X^{a, Z), t^{Y, /3) and T^(a, Z) via ()1.6p . Define the lower value 
of the SDG by 

F(x) = inf sup J^(y,/3), (1.8) 



and the upper value by 



U(x) = sup inf J^(a,Z). (1.9) 



The game is said to have value \iU = V . 

Theorem 1.1 of fSi shows that the SDG has value, and that U = V = u on G. 



Let X G G and 5 > be given. We say that a policy /? G -T is J-optimal for the lower 
game and initial condition x if supyg^y,/ J^(y, /3) < V{x) + 5. When a strategy /? G -T is 
given, we say that a control y G M is 5-optimal for play against (3 with initial condition x, 
if J^{Y,P) > supy/gjv/ J^{Y',I3) — 5. A pair (y, /?) is said to be a (5-optimal play for the lower 
game with initial condition x, if /3 is (5-optimal for the lower game and Y is 5-optimal for play 
against /? (both considered with initial condition x). Note that for such a (Y,(3) pair 

J^(y, p)-6< V{x) < r{Y, (3) + 6. 

An (a, Z) (5-optimal play for the upper game with initial condition x is defined in a similar 
manner. 



Our main result is the following. 
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Theorem 1.1. Let Assumption ll . 1\ hold. In addition, assume there exist uniformly continuous, 
bounded extensions of p and q to all o/M™ such that, for every x € M'", weak uniqueness holds 
for solutions of (|1.2p starting from x. Fix x £ G and let X and t denote such a solution and, 
respectively, the corresponding exit time from G. Then, given any sequence {5n}n>i, i 0, 
there exists a sequence of strategy- control pairs £ M x F , n > 1, with the following 

properties. 

i. For every n, the pair (/5",y") forms a Sn-optimal play for the lower game with initial 
condition x; 

a. Denoting X"^ = X^{Y"',P"') and t"" = tg{X"'), one has that Ar"), r") converges in 

distribution to {X{- /\t),t), as a sequence of random variables with values in C([0,oo) : 
G) X [0,oo]. 

An analogous result holds for the upper game. 

Remark. One can always find uniformly continuous bounded extensions of p and q, however, 
in general, without additional conditions weak uniqueness may not hold. A sufficient condition 
for the uniqueness to hold is that D'^u is Lipschitz on G, since then both p and q are Lipschitz 
and thus admit a Lipschitz extension to M™. 

2. Proof of the main result 

The organization of this section is as follows. We begin by recalling the Bellman- Isaacs form 
of (jl.ip . which is given in ()2.4p . Proposition 12.11 analyzes near maximizing and minimizing 
variables in (j2.4p . Following the construction of a strategy-control pair (that is later slightly 
modified, in the proof of Theorem II. ip . Proposition 12.21 proves its near optimality. Proposition 
12.31 shows that, under this pair, the coefficients of the state process converge to those of (jl.2p . 
This result, along with Lemmas I2.2H2.4| is then used to prove weak convergence of the corre- 
sponding processes and exit times. The proofs of Propositions 12.11 and 12.31 appear at the end 
of the section. 

The hypotheses of Theorem 11.11 are in force throughout this section. We will only prove 
the statement in Theorem 11.11 concerning the lower game. The proof for the upper game is 
analogous. 

For (a, c), (6, d) £ Ti, p £ M™ and S G S(m) (the set of symmetric m x m matrices), let 

^{a,b,c,d;p,S) = -^{a-byS{a-b) - {c + d){a + b) ■ p, (2.1) 

and denote 

A+ {p, S) = sup inf (j){a, b, c, d; p, S) . (2.2) 

It has been shown in [2] (see Proposition 5.1 therein) that for every p G M™, p and 
S G S(?Ti), one has 

A+{p, S) = A{p, S) := \p\-^p'Sp. (2.3) 
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Throughout, we denote 



p{x) = Du{x), p{x) = -r-r-T, S{x) = D'^u{x), 

\p{x)\ 

= I \.^ {D'^u{x) Du{x) - Aaou{x) Du{x)) 
\p{x)Y 

and 

'ilj{x,y,z) = -h{x) + (t){a,b,c,d-p{x),S{x)), y = {a,c), z={b,d). 
Since u satisfies (jl.ip in the classical sense, and since A'^ = A, we have 

sup inf ilj{x^y,z) = 0, x £ G. (2-4) 



Identity (12. 4p will be the basis for the construction of a (5-optimal play for the lower game. 
To present the construction we first need the following result. Its proof appears at the end of 
the section. 

Proposition 2.1. For every 6 € (0, oo) there exist € (0, oo) and : G ^ S"^^^ such that 
the following holds. 

i. For X eG, let z^x) = {b\x),d\x)) = {-p{x),d^). Then 

ini ^p(x,y, (x)) = min ip(x,y, z^ (x)) & [—5,0]. (2-5) 
y(^n i/g5'"-1x{0} 

Moreover, d*^ — s- oo as 6 ^ 0. 
a. With y^{x) = {a\x),0), 

i;{x,y'ix),z\x))e[-6,5], x e G. (2.6) 
Moreover, is Lipschitz in x for every 6. Finally, 

^ p, uniformly, as 5 — 0, (2-7) 

and 

d^{a^ — p) ^ 2q, uniformly, as (5 — > 0. (2-8) 

To define /3^'^ = (3^ (the dependence on the initial condition is suppressed in some instances), 
let Y = (Y^,K) £ M, with = {A,C), be given, and consider the equation 

dX = {A- b^{X))dW + (C + d^iX)){A + b^{X))ds, Xo = x (2.9) 

where b^{x) = —p{x), and d^{x) = d^. By the Lipschitz property of b^ , this equation has a 
unique solution. This defines a process = {b^{X),d^{X)), hence a mappmg, 
M, which is easily seen to be a strategy. This strategy will be denoted by P^. 
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Next, consider the equation 

dX = P\X)dW + Q\X)ds, Xq = x 

where 



(2.10) 



p\x) = a\x) - b\x) = a^{x) + p{x), 

q\x) = {c\x) + d\x)){a\x) + b\x)) = d\a\x) - p{x)), = 0. 

Since the coefficients P^,Q^ are Lipschitz, there is a unique solution to (j2.10p . Define Y^'^ = 
= {a^{X),c^{X)). Clearly {Y\1) G M and P^{Y\1) = {{b^{X),d^),d^). 

Towards arguing that the strategy-control pair constructed above forms a nearly optimal 
play, we shall use the following 

Lemma 2.1. For every x £ G, Y, Z £ M , one has 

r /-tAr -, 

u{x) = E u{Xt^r) + / {^{Xs,Ys, Zs) + h{Xs))ds , t > 0, (2.11) 
and, if E\t] < oo, one has 

(2.12) 



J{x,Y,Z)=V{x)-E I ij{Xs,Y,,Zs)ds 
where X = X{x, Y, Z) and r = tg{X). 



Proof. The two identities are immediate consequences of Ito's formula applied to the smooth 
function u, the boundary condition u = g on dG, and the equality u = V. □ 

In what follows, let cq < oo be a constant such that 

\h{x)\ + \g{y)\ + \u{x)\ + \Du{x)\ + Lip(p) < cq, x£G, ye dG. (2.13) 
Denote h = inf^^gc 1^(2^)1- 

Proposition 2.2. Fix x G G. There exist r],c e (0, oo) such that for every 6 G (0, ??), 
[Y^'^ , P^'^) forms a c6-optimal play for the initial condition x. 



Proof. Fix Y = {Y°,K) G M with Y° = {A,C). Let X denote the unique solution of I^Mi 

with this choice of {A, C) and let Z^, d^ be as introduced above (|230D . Then f3^{Y) = {Z\ d^). 
By ()2.5p . for every s, 

i^{X,,Y^,Zl)=ij{Xs,Y^,z'{X,)) > -6. (2.14) 
Let T] = h/2. Consider first the case h > 0. For 5 < r], we have by (j2.1ip 

E[t A r] < ci := 4/i~^Co, 

and consequently E[t] < ci, where t = [Y,P^]. Hence using (|2.14p in (|2.12p . 

r{Y, f3^) < V{x) + 6E[t] < V{x) + ci<5. (2.15) 
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Since y G M is arbitrary, this shows that [5^ is ci^-optimal. 

Consider now the case /i < 0. Fix e G 5"*"^ and let (e, 1) = 1" G M. It is easily checked 
(see Lemma 3.1 of [3]) that u\i j^^Y iX ^ > — oo. Thus misC{P^) := c > —oo, where for 
Per, C{I3) = supygA^ J^(y,/3). Let Ms = {Y e M : J''{Y,/3^) > c - 1}. Then C(/3) = 
supYeMs J^'i^^P)- Note that for Y G Ms, r = r^(y,/3^) < oo a.s. and 

c-l<riY, f)^) < -hE[T] + Co. 

Thus for the case h < as well, is C2(5-optimal, for some C2 G (0, oo). 

Recall that y/ = y^{Xs), where X is the unique solution of (f230|l and note that P^{{Y\1)) = 
{Z^{X),d^). By die]), 

iljiX„y^{Xs),z\Xs))<5. (2.16) 
Observing that E[t] < ci, where r = r^(y^ /J"^), we have using (f2T6]) in (I2J2D . 

J'=(y^/3^) > y(x) -ci5 > sup J^(y,/3'') -2(ci Vc2)<5, 

where the last inequality follows from the (ci V C2)5-optimality of . The result follows. □ 

The proof of the following proposition is given towards the end of the section. Denote by 
p* and q* the continuous, bounded extensions of p and q to M"*, satisfying the hypotheses of 
Theorem II. 1[ 

Proposition 2.3. Let {6n}n>i be a sequence in M4. such that 6n ^ as n ^ 00. Then there 
exists a sequence of (open) domains Gn-i CC G„ C G, Gn ] G as n ^ 00 and continuous, 
uniformly bounded maps Pn^Qn ffom to itself, Pn~'P*!Qn^Q*' uniformly on M"*, such 
that p* = pn and = g„ on Gn, where pn = ^{a^" + p) and qn = ^d''" {a^" — p). 

Lemma 2.2. With notation as in Proposition \2.3\ let Xn,X be solutions of 

dXn = 2p*„{Xn)dW + 2ql{Xn)dt, dX = 2p*{X)dW + 2q*{X)dt, 
respectively, starting from x, and given on suitable filtered probability spaces. Denote 

f(n,A:) =rG,(X"), f (/c) = tg,(X), f = TG{X). 
Then there exists a sequence {(■n}n>i, T 00 as n ^ 00, such that 

(X„(- Aa„),a„) ^ (X(- Af),f) 
as a sequence o/C([0,oo) : G) x [0, 00] -valued random variables, where ct„ = f(n,£„). 

Proof. The coefficients p* and (;* converge uniformly on to p* and q* , respectively, by 
Proposition 12.31 Moreover, by assumption, weak uniqueness holds for solutions to the SDE 
associated with {p*,q*), starting from x, for any x G M™. Thus Theorem 11.1.4 of [9] is in 
force, and we can deduce that X" converges to X in distribution, as n ^ 00. 
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We now assume without loss of generality that Xn,X are given on a common probability 
space and Xn X, a.s., in C([0, oo)). For t > let Et = {u : f{uj) < t}. Fix m € Et. Given 
A; G N, choose 6 > such that \yi — y2\ > S for all yi £ Gk, y2 G dG. Let uq = nQ{6,t,u}) be 
such that, for all n > no, \Xn — X\^ < 6. Note that X{f{u;)) G dG and so X„(f(a;)) ^ Gfc. In 
particular, f{n,k){u!) < f{Lo). Letting n — s- oo, we get limsup„^oQ r (n, A;) < f, for all cj G £"4. 
Since t > is arbitrary, we have that for every G N, limsup^^Q^^ f(n, k) < f a.s. Using lower 
semi-continuity property of exit times we then have a.s., 

f{k)< lim inf f(n,k) < lim sup f{n,k) < f . 
Also note that f{k) f a.s., as k ^ 00. 

Let F = {f < 00}. In what follows, for an event E, we will write P{EF) as Pf{E). Pf" is 
defined similarly. From the above display we have that for every e > 

lim sup limsup Pi;'( I 'f(n, k) — f\ > e) = 0. 

k^oo n->oo 

We can then find a sequence {e(A;)}fe>i, e{k) G (0, 00) such that e{k) | as A; — > 00 and 

limsuplimsupPi?(|'f(n, A;) — f| > e(A;)) = 0. 

fc^oo n-*oo 

Finally, choose a sequence {in}n>i such that | 00 as n ^ 00 and 

lim PF{\f{n,£n) -f\> e(4)) = 0. 

n^oo 

In a similar fashion, by choosing a further subsequence if needed, we have that for every r > 

lim PFc(f(n,en) < r) = 0. 

n^oo 

Combining the above displays ) ^ r in probability as n — > 00. The result 

follows. □ 

Lemma 2.3. Let X" be the (pathwise) unique solution of ()2.10l) with 5 = 5n (stopped when 
the boundary is reached). Let {Gn,PnjQn)n>i, P*,Q* be as in Proposition \2.3[ and {in}n>i be as 
in Lemma \2.SX Let X solve (jl.2p with initial condition x. Then 

(X"(.A77n),r/„)^(X(.AT),r), 

where = Tf;nA<„(X") and r = tg{X). 

Proof. Let X"',X be as in Lemma 12.21 Then from Proposition 12.31 iXi- Ar),f) has the same 
law as {X{- A r),r) and A fin)iVn) has the same law as (X"'(- A r]n),r]n), where ry" is 

defined similarly to ry" by replacing X" with X". By lower semi-continuity of exit times, 
liminf„ f(n, n) > r a.s. The result now follows from Lemma 12.21 on noting that ry" = f{n,n) A 



/SDG 



10 



Lemma 2.4. Let X he a solution of (jl.2p given on some filtered probability space, with Xq 
X (z G. Let T = tg{X). Then E[t] < oo and 



u{x) = E 



g{Xr) + I h{Xs)ds 





Proof. Applying Ito's formula to u{X) and recalling that n is a classical solution of (jl.ip . we 
obtain 



rAt 



u{x) = E u{XrM) + / h{Xs)ds 

L Jo 

for every i > 0. The property E[t] < oo is now immediate on recalling that h is either positive 
or negative, and bounded away from zero. The result follows on sending t — > oo. □ 

Proof of Theorem 11.11 Fix x e G. Let {X"- ,Gn,Pn,Qn^(n,Vn} be as in Lemma [Ol Let 
= (y^,<5n^^^^,<5n) where, for 5 > 0, (y^''', /3^'^) is as in Proposition [221 Note that 
X"' = X^(y", /?"■). We assume, without loss of generality, that (5„ < h/2 for n > 1. Then, as 
in the proof of Proposition 12.21 we deduce that 

E{7]n) < E{tg{X'')) < 4/i-ico, (2.17) 

where cq was introduced in (j2.13p . From Lemma 3.2 of 0], there exist € M and {5^}n>i; 
5^ i 0, such that f^^^^ = F^^^^ and 

E{Tn - Vn < 5l E{\X^ - X"(r,„)|2|^,J < 5l (2.18) 

where X" = X^(y",/?"), r" = (?",/?") and |X" -X"(r?„)|, = sup^g[^„~„] |X"(t) -X"(r/„)|. 

Recall that (3"' is C(5n-optimal. We now show that is (5* -optimal for play against /?", for 
some sequence (5* — > 0. From Lemma 12.31 and ()2.17p we have that 



E 



h{X-{s))ds + V{Xl) 



- E 


\l 




L JO 



h{X{s))ds + V{Xr) 



0, as n — >■ oo. 



From (f2T8]l 



E 


[/ 




L JO 



h{X'^{s))ds + V{XZ ) 



- E 


[/ 




L JO 



Tin 



h{X^s))ds + V{Xl) 



0, as n — > oo. 



Setting 5* = (5^ + (5^ + C(5n, we have on combining the above two displays 



J-(y",/3-) = E / h{X^)ds + g{X^{fn)) 

L Jo J 

> E[J\iXs)ds + ViXiT))]-i6l + 5f,) 
= V{x)-{6l + 6f,) 

> sup riY,n-s:, 
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where the equahty in the third hne above follows from Lemma 12.41 and the last inequality is a 
consequence of C(5„-optimality of (5"^ . Finally, from ()2.18p supo<(<oQ Ar/„) — Ar„)| — > 
and |r/„ — t„| — > in probability as n — > cxd. Thus, from Lemma 12.31 {X'^[- A t„),t„) 
{X{- A t),t) and the result follows. □ 

Proof of Proposition 12.31 For d € N, let /„, / : G ^ be uniformly bounded continuous 
maps such that fn—^f uniformly on G. Let F : M™' — > R"^ be a uniformly continuous bounded 
extension of /. Consider a sequence {En} of (open) domains with En~i CC En C G, ] G 
as n oo. We will show that there is a collection of uniformly bounded, continuous maps 
{F^ : n > 1, A; > 1} such that i^^ agrees with /„ on Ei^. and along some subsequence {A:„}„>i, 
Fj^" F, uniformly on M™. The result will then follow, on setting F = {p*,q*), f = {p,q), 

fn = ipn^qn)', with Gn = Ek„. 



Define 

Fnix) = /„(x)l^gg + F{x)l^^j^ru\a- 

Let he a C°° function on M*^ such that < ip{x) < 1, supp(V') C Bi{0) and /j^d ip{x)dx = 1, 
where -Br(O) is the ball of radius r in M™, centered at 0. Let ipk{x) = k"^'ip{kx). Define 

F^{x)=[ Fn{x-y)My)dy, F\x)=[ F{x - y)i,k{y)dy, x eM.^ . 

Let / G C~(M'") be such that < < 1 and 



p\x) 

Define 



1 if X G E'fc 
ifxGG^ 



F^{x) = p\x)fn{x) + (1 - pHx))F^{x), X G 

and 

F^{x) = p^{x)F{x) + (1 - /(x))F^(x), X G M™. 
Note that ^^(x) = fn{x) and F'^(x) = /(x) for x G Ffc and 

F„^(x) - F^(x) = p'=(x)(/4x) - /(x)) + (1 - p'=(x))(F„^(x) - F^(x)), x G 

Also 

sup sup \Fn{x) — F^{x)\ < sup |/n(x) — /(x)| — > 0, asn ^ OO. 
xeR"! fc>i xeG 

Combining the above two displays 

sup sup |F^(x) — F'^(x)| ^ 0, asn^oo. 

xeM™ fc>i 

Next note that supj-g^m \F^{x) — F{x)\ —^ 0, as k oo and therefore 

sup I-F'^(x) — F{x)\ — > 0, asA: — > oo. 
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Using the above two displays, we can find a sequence {kn\ such that F^" — > F uniformly on 
M™. By construction agrees with /„ on E^. The result follows. □ 

Proof of Proposition 12.11 We begin by constructing functions for which all conclusions 
of the proposition hold, save the Lipschitz property. We will then argue that one can find a 
Lipschitz regularization of each , for which all conclusions are still valid. 

With b = h{x) = —p{x), the second term of (j2.ip takes the form {c+ d){l — a- p{x))\p{x)\ > 0, 
and therefore the infimum of ip{x, (a, c), {b{x),d)), over c, is attained at c = 0. The function 
a I— > t(j{x,{a,0),{—p{x),d)) is continuous, and thus the minimum over S"^^^ is attained. For 
an arbitrary choice of , we have by (12. 4p . 

-f^{x):= min i{j{x,y, (x)) < 0. (2.19) 

Later in the proof it is shown that for a suitable choice of d^, j^{x) > —5 for all x G G. 

For each 6 and x let a^{x) be a minimizer of a i— > ip{x, (a,0), {—p{x),d^)) over S"^~^. Write 
y\x) = (a^(x),0). From (l2l9D -f\x) = i;{x,y^ {x), z\x)) < 0. 

We show now that for any choice of d^ such that ^ oo as 5 ^ 0, 

a^{x) — > p{x) as 5 — > 0, uniformly in x. (2.20) 

Assuming the contrary, there exists e > and, for every 6 > 0, xs & G, such that 

\a^{xs)-p{xs)\> e. (2.21) 

However, because of the upper bound on 7"^, it follows that 

/(I -a^(x) ■pix))\p{x)\ < ci, 

for some constant ci not depending on x and 5. This contradicts (|2.2ip and thus (j2.20p follows. 
Henceforth we will assume that d^ ^ 00 as 6 ^ 0. 

Since is a minimizer, we have that ip{x,y^ (x), (x)) < ^(x, {p{x) , 0) , z^ (x)) . Along with 
the uniform convergence in ()2.20p . this implies 

limsupsup(i^(l — a^{x) ■ pix))\p{x)\ < 0. 

Consequently, 

/(I - a^{x) ■ p{x)) ^ as (5 ^ 0, uniformly in x. (2.22) 

We next show that 

Q^{x) := d^{a\x) - p{x)) 2q{x) as 5 ^ 0, uniformly in x. (2.23) 
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Denote by (j) the map a ^ 0(a, h{x),Q,d^;p{x),S{x)). By the La grange multiphers theorem, 
every a G S'^~'^ , which minimizes (p{a) satisfies D(l){a) + Aa = for some A E M. Thus by 
definition of a^{x), suppressing the dependence on 5 and x, 

Aa = S{a + p) + dp, (2.24) 

\ = a'S{a+p)+da-p. (2.25) 

Hence 

Q = dia — p) = da — ^ 
\P\ 

a ^ S(a+p) 

= d{l -a-p)a - -^a'S{a+p) + -T^\p'Sp+ r^^Sp = 2q, 

\p\ \p\ \p\ \p\ 

where the convergence is uniform, and we have used (j2.20p and (j2.22p on the last hne. This 
shows 

We now estimate 7''. Suppressing x and 5, 

l = i^{x,y,z) = -h- ^{a+pyS{a + p) - d{a - p) - p. 

The second term converges uniformly to —2p'Sp which equals h by (jl.ip . while the last term 
converges to zero by (I2.22p . Consequently we may, and will, choose d^ to grow sufficiently fast 
so that, for every 5 S (0, (5o), 

inf7^(x) > — . (2.26) 
X 2 

We now show that, for 5 < 60 sufficiently small, is continuous. The proof is based on 
(j2.24p and (|2.25p . We will suppress 5 from notation unless needed. 

For 2 = 1, 2 let Xj G G. Let pi = p{xi), and similarly define the quantities pi, Si, ai and A^, 
i = 1, 2. Let Ap = pi- p2, and similarly define Ap, AS, Aa and A\. By (p:^!]) and 

AXai + \2Aa = AS{ai + pi) + S2{Aa + Ap) + dAp, 

AX = Aa'Si{ai + pi) + a'2AS{ai + pi) + a'2S2{Aa + Ap) + dAa ■ pi + da2 ■ Ap. 
Thus, with \A\ = max{|Z\p[, \Ap\, \AS\}, and with ci, C2 independent of 5, 

|A2||Z\a[ < |Z\A| + ci\A\ + ci\Aa\ + d\A\ 

< C2\A\ + C2\Aa\ + d\Aa ■ pi\ \pi\ + 2d\A\. 

By (j2.25p and uniform convergence of a to p, one can find a constant C3 > and a constant 
61 € (0, 6q), such that for all 6 < 61, one has A2 > c^d^, d^ G (^, 00), and 

sup \a^{x) — p{x)\ \pi{x)\ < C3/4. 
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Note that 

\Aa ■pi\< + 02 - 2pi| < ^|Z\a||ai + 02 - pi - P2I + |^|- 

Thus for ah 5 < 5i, 

C3|Z\a| < ^(1^1 + \Aa\) + + C4l^|- 

Consequently, for all 5 < 5i, |Z\a| < —(03 + C4)|Z\|. The continuity of follows. 

Finally, the functions need not be Lipschitz in x. However, using a straightforward mol- 
lification argument, given e > 0, one can find a Lipschitz function a*^'^, with values in 5™"^, 
that is e-close to in the uniform topology. It is possible to then let e depend on 5 in such a 
way that := a^'^^^^ satisfy results analogous to (j2.20p . (j2.22p and (j2.23p . Furthermore, using 
(|2.19p and ()2.26p . one can ensure that satisfies (j2.6p . This completes the proof. □ 



References 

[1] G. Aronsson. Extension of functions satisfying Lipschitz conditions. Ark. Mat. 6, 551-561 
(1967) 

[2] G. Aronsson. A mathematical model in sand mechanics: presentation and analysis. SIAM 

J. Appl. Math., 22 (1972), 437-458 
[3] R. Atar and A. Budhiraja. A stochastic differential game for the inhomogeneous 00- 

Laplace equation. Preprint, Math. larXiv:0808. 14571 
[4] E. N. Barron, L. C. Evans and R. Jensen. The infinity Laplacian, Aronsson's equation 

and their generalizations. Preprint 
[5] R. Jensen. Uniqueness of Lipschitz extensions: Minimizing the sup norm of the gradient. 

Arch. Rational Mech. Anal, 123(1) :5174, 1993. 
[6] R. V. Kohn and S. Serfaty. A deterministic-control-based approach to motion by curvature. 

Comm. Pure Appl. Math. 59 (2006), no. 3, 344-407 
[7] Y. Peres, O. Schramm, S. Sheffield and D. B. Wilson. Tug-of-war and the infinity Lapla- 
cian. .Jour. AMS, to appear 
[8] H. M. Soner and N. Touzi. A stochastic representation for mean curvature type geometric 

flows. Ann. Probab. 31 (2003), no. 3, 1145-1165 
[9] D. W. Stroock and S. R. S. Varadhan. Multidimensional Diffusion Processes. Springer- 

Verlag, Berhn, 2006 

[10] A. Swiech. Another approach to the existence of value functions of stochastic differential 
games. J. Math. Anal. Appl. 204 (1996), no. 3, 884-897 

Department of Electrical Engineering 
Technion-Israel Institute of Technology 
Haifa 32000, Israel 

Department of Statistics and Operations Research 
University of North Carolina 
Chapel Hill, NC 27599, USA 



